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ABSTRACT 


This  report  describes  an  effective  and  mathematically  rigorous  finite  process  for 
determining  whether  or  not  a  given  regular  switching  function  is  linearly  separable, 
and  if  it  is,  for  deriving  a  minimal  set  of  integral  weights  and  threshold  to  realize 
the  function.  The  procedure  uses  the  integral  linear  programming  recently  developed 
by  R.  E.  Gomery;  the  algorithm  is  described  in  detail,  and  a  corresponding  computer 
program  for  implementing  the  technique  can  be  obviously  given  without  difficulty. 

As  an  illustrative  example,  a  regular  switching  function  of  nine  variables  is  worked 
in  detail.  (The  same  function  was  studied  earlier  by  D.  G.  Willis  in  disproving  a 
conjecture.) 
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Section  1 
INTRODUCTION 


The  synthesis  and  minimization  problem  for  linearly  separable  switching  functions 
is  a  fundamental  problem  in  threshold  logic.  The  problem  is  to  determine  whether 
or  not  a  given  switching  function  is  linearly  separable  and,  if  it  is,  to  find  the  most 
economic  system  of  weights  and  threshold.  In  our  previous  reports  (Refs.  1-7), 
various  methods  have  been  applied  to  solve  this  problem. 

For  most  of  the  threshold  devices  realizing  linearly  separable  switching  functions, 
the  weights  and  the  threshold  are  required  to  be  integers.  However,  the  optimal 
systems  of  weights  and  threshold  obtained  by  the  methods  developed  in  the  previous 
reports  may  fail  to  be  integral;  in  fact,  D.  G.  Willis  (Ref.  8)  discovered  a  linearly 
separable  switching  function  of  9  variables  of  which 

(2,  2,  3,  5,  5,  6.5,  6.5,  6.5,  9;  12) 

is  the  only  minimal  system  of  weights  and  threshold.  This  disproves  the  conjecture 
of  Elgot  and  Muroga  (Ref.  9),  and  Muroga,  Toda  and  Takasu  (Ref.  10),  about  the 
existence  of  minimal  weights  which  are  all  integers. 

Because  of  this,  it  is  desirable  to  find  integral  systems  of  weights  and  threshold  that 
are  the  most  economic  among  a  given  linearly  separable  function  F.  This  problem 
will  be  referred  to  as  the  integral  minimization  problem.  R.  O,  Winder  (Ref.  11) 
proposed  an  approach  and  also  mentioned  several  drawbacks.  The  problem  remained 
unsolved  as  Winder  remarked  in  Ref.  11. 

The  objective  of  the  present  report  is  to  develop  an  application  of  the  integral  linear 
programming  techniques  introduced  by  R.  E.  Gomery  (Ref.  12  and  13)  to  the  integral 
minimization  problem  for  linearly  separable  switching  functions. 
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In  the  sections  2-4,  we  give  an  elementary  exposition  of  Gomery’s  theory  together 
with  a  modified  finiteness  proof  so  that  it  holds  for  our  integral  minimization  problem. 
In  section  5,  we  give  an  illustrative  example  which  is  used  in  the  later  part  of  the 
report.  In  the  sections  6-9,  we  formulate  the  synthesis  and  minimization  problem 
and  then  apply  the  method  developed  in  sections  2-4  to  solve  the  integral  minimization 
problem.  The  Willis  example  previously  mentioned  is  used  as  an  illustration,  and  a 
minimal  system  of  integral  weights  and  threshold  is  computed  by  this  process.  The 
result  is 

(2,  2,  3,  5,  6,  7,  7,  9;  12) 


f 
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Section  2 

STANDARD  LINEAR  PROGRAMS 

A  standard  linear  program  is  to  find  nonnegative  real  numbers  that  minimize  (or 
maximize)  a  given  linear  function  subject  to  a  given  system  of  linear  inequalities. 

Since  a  maximum  problem  is  reduced  to  a  minimum  problem  simply  by  multiplying 
the  given  linear  function  with  -1,  we  may  study  the  standard  minimum  program  only. 

For  this  purpose,  let  us  consider  a  given  linear  function 

q 

a  +  >  a  .  t.  I 

o,o  Z,  o,j  j 

j=l 

of  q  variables  t^,  . . .  ,  t  ,  where  aQ  0»  aQ  y  •  *  *  »  a0  q  are  given  real  numbers.  On 
the  other  hand,  let 

q 

a.  +  V  a.  .  t.  >  0  ( 

i,o  Z*  It  j  J 

j=l 

where  i  =  1,  2, ...»  p,  be  a  given  system  of  p  inequalities  in  the  same  variables  t^, 

. . .  ,  t  with  given  real  coefficients  a,  .  and  constant  terms  a.  .  Then,  the  standard 

q  i,  j  i*o 

linear  minimum  program  is  the  problem  of  finding  nonnegative  real  numbers  t^, . . . , 

t  that  minimize  the  given  linear  function  (1)  subject  to  the  system  (2)  of  p  linear 

inequalities. 

Now,  let  y  denote  the  given  linear  function  (1)  and  let  x^,  (i  =  l,  2,  ...»  p),  denote 

the  linear  function  on  the  left  side  of  the  inequality  (2).  Consider  y,  x^ . x^ 

also  as  variables.  Then,  the  standard  linear  minimum  program  described  above  can 
be  restated  as  follows. 
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Find  the  minimum  value  of  the  variable  y 

subject  to  the  following  p  +  1  linear 

equations 

q 

y  =  a  f 

J  0,0 

Vat 

L,  o.j  j 

(3) 

j  =  i 

q 

x.  =  a,  + 

i  i,o 

I  “i.j'j 

(4) 

j-i 

where  1  =  1,  2,  ...,  p,  and  the  condition  that 

x,  >  o.  (1  - 

1.  2 . p) 

(5) 

II 

1 

o 

All 

*.— » 

1,  2, . . . ,  q) 

(6) 

Let  A  denote  the  p  +  1  by  q  +  1  matrix 

a=i-i.ji 

(7) 

where  0  <  i  <  p  and  0  <  j  <  q.  The  matrix  A  is  said  to  be  dually  feasible  in  case  the 
q  columns 


"j  (ao,r  \j . W 

where  J  =  1,  2 . q,  are  lexicographically  positive  as  defined  in  Ref.  7.  In 

particular,  A  is  dually  feasible  if 

a0,j  >0*  <1  =  1.2 . q) 

If  the  matrix  A  is  dually  feasible,  then  our  standard  linear  minimum  program  is  also 
said  to  be  dually  feasible. 

Now,  let  us  assume  that  our  standard  linear  minimum  program  is  dually  feasible.  Then, 
the  dual  simplex  method  of  C.  E.  Lemke  (Ref.  14)  as  formulated  in  Ref.  7  can  be  applied 
to  obtain  an  optimal  solution  of  the  program  or  to  prove  the  nonexistence  of  such. 
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If  our  standard  linear  minimum  program  has  an  optimal  solution,  then,  after  a  finiie 
number  of  pivoting  operations  as  described  in  Ref.  7,  the  dual-simplex  method  reduces 
our  given  linear  minimum  program  to  the  problem  of  finding  the  minimum  value  of  the 
variable  y  subject  to  the  following  p  +  q  *  1  linear  equations 

q 

y  -  b  +  "V  b  .  u,  (8) 

J  o,o  Z#  o,j  j 

j=t 

q 

*1  ■  \o  *  X  \j  “j  <9' 

j=l 

where  i  =  1,  2,  p  +  q,  and  the  condition  that 

Xj  >  0,  (i  =  1,  2 . p  +  q)  (10) 

Here,  the  symbols  (p  <  i<q),  are  used  to  denote  the  given  nonbasic  variables 
tj,  ....  tq  with 

*J  =  xp+i’  (j  =  lf  2 . q) 

and  the  new  nonbasic  variables  u^,  •  •  • »  also  appear  on  the  left  members  of  (9)  as 
q  of  the  p  +  q  variables  Xj,  ....  x  .  Furthermore,  the  p  +  q+1  by  q+1 
matrix 


(0  <  i  1  p+q,  0 1)  £ q) ,  remains  dually  feasible  and  satisfies  the  condition 

b.  >  0,  (l<i<p  +  q)  (11) 

1 ,  o 

Because  of  the  condition  (11),  the  trial  solution 


is  an  optimal 


xi  =  bi,o’  <i  =  1’  2 . P+q) 

solution  of  our  standard  linear  minimum  program. 
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Let  a  and  denote  the  (p  +  q  +  1)  vectors 


a  =  (a  ,  a1  , 

O  '  O,  O  1,0 


a  ,  0, 
p,o’ 


0) 


Then,  by  (33)  of  Ref,  7,  0  is  greater  than  oq  in  the  lexicographical  order  unless 
the  given  matrix  A  satisfies  the  condition 


ai  o  >  0  <1<  i<P) 

In  case  (14)  is  satisfied,  then  we  may  take  0  =  o  . 


(14) 
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Section  3 

INTEGRAL  LINEAR  PROGRAMMING 

In  many  practical  linear  programs,  the  optimal  solutions  are  required  to  be  integers. 
For  example,  in  the  classical  transportation  problem,  if  the  commodity  to  be  shipped 
is  some  indivisible  good  such  as  a  number  of  automobiles,  then  the  constraints  and 
function  to  be  minimized  are  just  as  usual  but  only  integral  values  of  the  variables  are 
admissible. 

In  1958,  R.  E.  Gomery  (Refs.  12  and  13)  introduced  a  general  method  for  integral 
solutions  to  linear  programs.  A  simple  exposition  of  Gomery's  algorithm  with  some 
slight  improvement  in  the  finiteness  proof  is  given  in  this  section.  A  numerical 
illustrative  example  is  worked  out  in  the  following  section. 

For  this  purpose,  let  us  assume  that  the  coefficients  and  constant  terms 

a.  (<KiSp,  O^j^q) 

A»  J 

in  (1)  and  (2)  are  integers.  Then,  the  standard  integral  linear  minimum  program  is 
the  problem  of  finding  nonnegative  integers  t y  . . . ,  t  which  minimize  the  linear 
function  (1)  subject  to  the  system  (2)  of  linear  inequalities. 

Introducing  new  variables  y,  x^,  . . . ,  as  in  the  preceding  section,  we  obtain  an 

equivalent  problem  of  finding  integers  t^,  ...»  t  which  minimize  the  variable  y 

subject  to  the  p  +  1  linear  equations  (3)  and  (4)  and  the  condition  (5)  and  (6).  Since 

the  numbers  a.  (0^i=p,  O^j^q),  are  assumed  to  be  integers,  and  since  the 
i»  J 

variables  t ^  , . . . ,  t  are  required  to  be  integers,  it  follows  that  the  variables 
y,  x^,  . . . ,  Xp  must  also  have  integral  values  given  by  the  equations  (3)  and  (4). 

Hence,  our  standard  integral  linear  program  reduces  to  the  problem  stated  as  follows: 
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Find  nonnegative  integers  y,  x^,  . ..,  xp,  tj,  . ..,  t^  which  minimize  y  and 
satisfy  the  p  +  1  linear  equations  (3)  and  (4)  in  section  2, 

Now,  let  us  consider  our  problem  as  a  usual  standard  linear  program  and  assume 
that  it  is  dually  feasible  as  defined  in  section  2.  Hence,  we  can  apply  the  dual-simplex 
method  to  our  program.  The  result  is  that  either  the  equations  (3)  and  (4)  have  no 
nonnegative  solution  whatsoever  or  our  program  has  an  optimal  solution  that  is  not 
necessarily  integral. 

If  the  equations  (3)  and  (4)  have  no  nonnegative  solution,  then  our  given  standard 
integral  linear  minimum  program  certainly  has  no  optimal  solution  in  integers.  There¬ 
fore,  our  problem  is  solved  negatively  in  this  case. 

On  the  other  hand,  if  our  program  has  an  optimal  solution  that  is  not  necessarily 
integral,  then  the  dual-simplex  method  reduces  the  given  program  to  the  problem  of 
finding  nonnegative  integers 


which  minimize  y  and  satisfy  the  equations  (8)  and  (9)  as  described  in  section  2. 
If  all  of  the  p  +  q  +  1  real  numbers  in  the  leading  column 


0O  =  <*>0,0’ 


1,0’ 


•  ’  bp+q,o* 


of  the  matrix  B  of  the  equations  (8)  and  (9)  are  integers,  then  the  trial  solution  (12) 
and  (13)  is  an  optimal  integral  solution  of  our  given  program.  Therefore,  our  problem 
is  solved  affirmatively  in  this  case. 

In  the  remainder  of  this  section,  we  shall  consider  the  case  in  which  not  all  of  the 
p  +  q  +  1  numbers  in  the  leading  column  /3q  of  the  matrix  B  are  integers.  Then, 
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the  trial  solution  (12)  and  (13)  is  an  optimal  solution  of  our  given  program,  but 
unfortunately  it  is  not  integral. 


Choose  the  first  entry  b.  in  0  from  top  down  which  fails  to  be  an  integer;  in 

i,o  o 

other  words,  let  i  denote  the  smallest  nonnegative  integer  such  that  b.  is  not 
O  1q»  o 

an  integer.  Consider  the  equation 


q 


*2 


bi  Juj 

O  J 


(15) 


where  Xi  stands  for  y  in  case  i  =0. 
l  o 

o 

Let  h  denote  the  smallest  integer  not  less  than  b.  ,  and,  for  each  j  =  1,2, 
O  1.0*  o 

. , . ,  q,  let  h.  denote  the  largest  integer  not  greater  than  b.  ..  Let 
J  1o*  J 

\ho-bio>o*  (ifj  =  0) 

b,  .  -h.,  (if  j  =  1,  2 . q) 

o,J  J 

Then  we  have 

^  ho  -  so’ 

Vj  j  hj  +  s,, 

with  0<8j  <  1  for  each  j  =  0,  1,  2,  . . . ,  q. 

Substituting  these  values  of  b,  into  (15),  we  obtain 

1o»  J 


(if  j  =  0) 

(if  j  =  1  ,  2  , .  .  .  ,  q ) 


q 


2  Vj 

J  =  1 


-  S 


o 


+ 


q 


23)uj 

j  =  i 


(16) 
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For  any  Integral  solution  of  our  program,  Uj,  . . . ,  u^  and  are  integers.  On 
the  other  hand,  ho,  hj . hq  are  integers  by  definition.  Hence,  the  left  member 


Xp  +  q  +  1 


(17) 


of  the  equation  (16)  must  be  an  integer.  Furthermore,  since 


8o< 


1. 


q 


I  v>J0 

J  =  i 


the  right  member  of  (16)  must  be  greater  than  -1.  Thus,  the  integer  xp+q  + 1  is 
nonnegative  and  we  obtain  an  equation 


p+q+l 


"8o  + 


I 

J  =  1 


Vj 


(18) 


Now,  let  us  adjoin  this  additional  equation  (18)  to  the  system  (9)  and  let 


bp+q+ 1,  J 


(if  j  =  0) 

(if  j  =  1,  2,  ....  q) 


Thus,  we  obtain  the  following  system  of  p  +  q+l  linear  equations 


=  b 


i,o 


I 
)  =  1 


bi.JUJ 


(19) 


where 


i  =  1,  2 . p  +  q+l. 
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By  the  construction  of  (18),  we  have  proved  that,  for  any  nonnegative  integral  solution 


(x^,  . . . ,  Xp  of  the  system  (9),  there  exists  a  nonnegative  integer  x  +  j  such 
that  (x^,  ,  xp  +  q»  xp  +  q  f  ^  is  a  nonnegative  integral  solution  of  (19).  Conversely, 

if  (Xj,  . . . ,  x  ,  Xp  t  q  +  is  any  nonnegative  integral  solution  of  (19),  then 
(Xj,  ...»  xp  +  q^  *s  cieariy  a  nonnegative  integral  solution  of  the  system  (9). 


Therefore,  our  standard  integral  linear  program  reduces  to  the  problem  of  finding 
nonnegative  integers 


y,  x- ,  . . . ,  x  ,  x  - 

J  1  p  +  q  p  h  q  ^  1 

which  minimize  y  and  satisfy  the  p  +  q  +  2  linear  equations  (8)  and  (19). 

Since  the  system  (8)  and  (9)  is  dually  feasible  and  since  s.  ?0  for  each  j  =  1,  2, 

. . . ,  q,  it  follows  that  the  system  (8)  and  (19)  is  also  dually  feasible.  On  the  other 

hand,  since  b  1  =  -s  is  negative,  the  trial  solution  of  (8)  and  (19)  is  not 

p  +q  +i,o  o 

nonnegative.  Thus,  we  can  apply  the  dual -simplex  method  to  this  new  system  (8)  and 
(19).  In  fact,  the  first  new  nonbasic  variable  to  be  brought  in  is  the  variable 

*p  +  q+r 

The  result  of  the  dual-simplex  method  will  either  prove  that  (19)  has  no  nonnegative 
solution,  or  give  an  optimal  solution  of  (8)  and  (19)  that  may  fail  to  be  integral. 

If  the  system  (19)  has  no  nonnegative  solution,  then  it  certainly  has  no  nonnegative 
integral  solution.  It  follows  that  the  system  (9)  also  has  no  nonnegative  integer 
solution.  This  solves  our  standard  integral  linear  program  negatively  in  this  case. 

On  the  other  hand,  if  (8)  and  (19)  have  an  optimal  solution  that  is  not  necessarily 
integral,  then,  after  a  finite  number  of  pivoting  operations,  the  dual-simplex  method 
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reduces  (8)  and  (19)  to  the  system  of  p  +  q  +  2  linear  equations 


y 


X 


i 


Ci.JVJ 


(20) 


(21) 


with  i  =  l,  2 . p  +  q+1  and  satisfying  the  condition 

ci  o  >  0,  (l<i<p  +  q  +  1)  (22) 

Here,  the  new  nonbasic  variables  Vj . vq  also  appear  on  the  left  members  of 

(21)  as  q  of  the  p  +  q+1  variables  x^,  ....  xp+q+  j* 

Let  f)Q  and  yQ  denote  the  (p+q  +  1)  vectors 


*o  ~  ^o.o’  bl,o’  bp  +  q,o) 


Yo  “  ^co,o*  cl,o’  Cp+q,o) 


Then  it  follows  from  the  dual  feasibility  and  the  dual-simplex  method  that  yQ  ^  PQ 
in  the  lexicographical  order. 


Because  of  (22),  the  trial  solution 


y 


c 


0,0 


X 


i 


c 


1,0 


(23) 

(24) 
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with  i  =  1,  2,  . . . ,  p  i  q  i  J,  is  an  optimal  solution  of  (8)  and  (19).  Therefore,  it 
follows  that 


y 


c 


o,  o 


(25) 


xi  '  ci,o-  0  =  !»  2»  ••  • »  P  ■*  *1) 


(26) 


is  a  feasible  solution  (8)  and  (9). 


If  c  ,  c„  ,  c  are  integers,  then  c  -  is  also  an  integer  according 

o,o  l,o*  pfq,o  H  p  +  q+l,o  &  & 

to  the  construction  of  the  last  equation  in  the  system  (19).  In  this  case,  the  trial 
solution  (23)  and  (24)  is  an  optimal  integral  solution  of  (8)  and  (19);  hence  (25)  and  (26) 
is  an  optimal  integral  solution  of  (8)  and  (9).  Thus,  our  standard  integral  linear 
program  is  solved  affirmatively. 


It  remains  to  study  the  case  where  not  all  of  the  numbers  c  .  c-  , 
J  o,  o  1,  o 

are  integers. 


c 

P  +  q»  o 


Choose  the  first  entry  c.  in  y ^  from  top  down  which  fails  to  be  an  integer;  that 

is,  let  i  denote  the  smallest  nonnegative  integer  such  that  c,  is  not  an  integer, 
o 

Consider  the  equation 


x. 

l 


o 


c. 

v° 


♦  y  c.  .v. 


j-i 


VJ  3 


(27) 


where  stands  for  y  in  case  iQ  =  0. 
o 

Now,  we  can  iterate  our  operation  on  (27)  and  the  system  (20)  and  (21)  exactly  as  we 
did  on  (15)  and  the  system  (8)  and  (9). 

In  the  next  section,  we  prove  that  the  process  stops  after  a  finite  number  of  iterations 
provided  that  either  of  two  mild  conditions  holds.  The  final  result  is  that  either  the 
given  program  has  no  integral  feasible  solution  or  this  process  gives  an  optimal 
integral  solution  in  a  finite  number  of  iterations. 
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Section  4 

FINITE  NESS  PROOF 

Throughout  the  present  section,  we  shall  assume  that  at  least  one  of  the  following 
two  conditions  (A)  and  (B)  is  satisfied: 

(A)  The  nonnegative  solutions  of  the  system  (2)  of  p  inequalities  form 
a  bounded  set  S  of  the  q-dimensional  Euclidean  space  R^. 

(B)  The  system  (2)  has  a  nonnegative  solution  in  integers,  and  the 

coefficients,  . . .  a^  _  in  (1)  are  all  positive,  that  is, 

o,  1  o,q 

a  .  >  0,  (j  =  1 . q) 

U»  J 

Under  this  additional  assumption,  we  can  prove  that  the  process  which  is  described 
in  the  preceding  section  must  stop  after  a  finite  number  of  iterations. 

For  this  purpose,  let  us  assume  the  contrary  and  deduce  the  following  contradiction. 
(Then  the  iterative  process  in  the  preceding  section  would  apply  infinitely  many  times. ) 
Let  k  ^0  be  any  nonnegative  integer.  After  the  k^1  iteration  of  the  process,  our 
given  standard  integral  linear  program  reduces  to  the  problem  of  finding  nonnegative 
integers 


*  X1 . Vq  +  k 


which  minimize  y  and  satisfy  the  system 


y  - 


d(k)  +  y  d(k)  w(k) 

0,0  Z-  0,J  j 

j  =  l 


X,  = 


df>  +  y  n«  w« 

1,0  Z.  i,  J  ) 

j  =  l 


4-1 


(28) 
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with  1  =  1,  2 . p  +  q  +  k  and  satisfying  the  condition 


df^O.  (l<ilp  +  q  +  k) 


(30) 


Here,  the  houbasic  variables  w^  ,  w^'  also  appear  on  the  left  members  of 

(29)  as  q  of  the  p  +  q  +  k  variables  x^  . . . ,  xp  +  q  +  k*  Note  that  (28)  and  (29) 
reduce  to  (8)  and  (9)  when  k  =  0  and  to  (20)  and  (21)  when  k  =  1. 

(M 

Let  6^  denote  the  (p  +  q  +  1)  vector 


6(k)  m  /d(k)  d(k)  d(k)  \ 

6o  o’  dl,o .  p  +  q.o  J 


Then  it  follows  from  the  dual  feasibility  and  the  dual-simplex  method  that 


»*-»  i  «*> 

o  o 


(31) 


in  the  lexicographical  order  for  every  k  >  1. 


In  particular,  (31)  implies 


d(k-i>  <  d(k) 

0,0  ~  0,0 


(32) 


for  every  k  >1.  In  other  words,  the  infinite  sequence 


d«* ,  d<« . d« 

0,0’  0,0’  o,o’ 


(33) 


is  monotone  nondecreasing. 

Next,  we  can  prove  that,  under  our  additional  assumption  made  at  the  beginning  of  this 
section,  the  infinite  sequence  (33)  of  real  numbers  is  bounded  above. 
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In  fact,  if  the  condition  (A)  is  satisfied,  then  the  continuous  function  (1)  is  bounded 
for  all  feasible  solutions  of  (2).  Since  is  the  value  of  (1)  for  the  feasible 

solution 

t  -  X  -  dW. 

j  p  +  j  P  +  j,o 

where  j  =  1,  2,  ...,  q,  the  sequence  (33)  is  bounded. 

On  the  other  hand,  if  the  condition  (B)  is  satisfied,  then  the  system  (2)  has  a  non¬ 
negative  integral  solution 

tj  —  (j  ~  1*  2,  . . . ,  q) 
and  the  linear  function  (1)  has  the  number 

q 

T?  =  a  +  >  a  r. 
o,o  Z,  o,j  j 

j  =  l 

as  its  value  for  this  solution  of  (2).  Since  the  coefficients  a.  .  are  assumed  to  be 

M  J 

integral,  it  follows  that 

q 

y  =  T]  =  a  +  >a.t. 

9  OfO  Z  0,j  j 

j=l 

q 

i  i,o  Zr  i.j  j 

j  =  l 

where  i  -  1,  2,  . . . ,  p  is  an  integral  feasible  solution  of  (3)  and  (4),  Let 

+  j  =  (j  ~  1»  2f  . , , ,  q) 

then  y  =  V,  ^  (i  =  1,  2,  . . . ,  p  +  q)  is  an  integral  feasible  solution  of  (8)  and  (9). 
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By  the  construction  of  the  iterative  process  in  the  preceding  section,  there  exists  a 
nonnegative  integer  +  ^  for  each  k  >1  such  that 


y  = 


4 


i 


is  a  feasible  solution  of  (28)  and  (29).  Since 


y 


(i  =  1,  2,  . . . ,  p  +  q  +  k) 


(i  =  1,2,  ...  ,  p  +  q  +  k) 


is  an  optimal  solution  of  (28)  and  (29),  we  have 


(k)  < 

0,0“ 


Hence  the  sequence  (33)  is  bounded  above  in  this  case. 

Thus,  we  have  proved  that  the  sequence  (33)  is  bounded  above  provided  that  at  least 
one  of  the  two  conditions  (A)  and  (B)  holds. 


As  a  nondecreasing  sequence  which  is  bounded  above,  the  sequence  (33)  converges  to 
its  least  upper  bound  e^,  in  symbols 


Lim  d^  *  e 
i  — .  o*o  o 
k— «)  » 


(34) 


Let  h  denote  the  smallest  integer  not  less  than  e  ,  then  we  have 
o  o 


e  <  h 
0*0 


h  -e  <  1 
o  o 


By  (34) ,  there  exists  a  nonnegative  integer  kQ  such  that 


s  =  h  -  d  <  1 
o  o  0,0 
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On  the  other  hand,  since  eQ  is  the  least  upper  bound  of  the  sequence  (33),  we  have 


-  d^o>  >  o 


s  =  h  _  _ 

O  O  0,0” 


If  s  =0,  then  wp  havp 
u 


l<ko)  = 

o, 


e 

o 


h 


o 


Hence  eQ  =  hQ  is  an  integer  and 


j(k)  = 

o,  o 


=  h 


coy 


Otherwise,  if  a  >0,  then 
o 


(k0)  = 

o,  o 


s 


o 


(35) 


is  not  an  integer.  According  to  the  rule  of  choosing  an  equation  in  the  iterative 
process,  the  equation  (28)  is  to  be  chosen  to  construct  the  new  equation 


xp+q  +  k0+ 1 


S. 


J 


(36) 


where 


_  -  h 

Sj  0,j  *y 


(j  =  1,  2 . q) 


(k  ) 

with  h,  standing  for  the  largest  integer  not  greater  than  d'  o' 
]  J 


Adjoin  the  equation  (36)  to  the  system  (28)  and  (29)  with  k  =  kQ  and  apply  the  dual- 
simpiex  method  to  the  system  (28),  (29),  and  (36).  By  assumption,  we  will  obtain  an 
optimal  solution  given  by  the  vector  ^  •  Since  -sq  is  the  only  negative 

constant  term  in  the  system  (28),  (29),  and  (36),  the  first  pivoting  in  the  dual-simplex 
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method  is  to  replace  one  of  the  nonbasic  variables  , . . . ,  by  the  new 

variable  ^  +  0+1*0  + j-  according  to  the  rule  of  the  dual-simplex  method,  the 
variable  w^°>  is  selected  to  be  replaced  by  xp  +  q  +  j<  +i>  then  equations  (28),  (29), 
and  (36)  will  be  transformed  into  the  form: 


y  =  f  +  >  f  .  z. 

0,0  o,  j  J 

j  =  l 


(37) 


x  =  f.  +  >  f.  ,z. 

i  i»o  L,  t.J  J 
j  =  l 


(38) 


with  i  =1,  2  , . . . ,  p  +  q  +  k  +  1,  where  the  new  nonbasic  variables  z^  , . . . , 
are  given  by 


^  wj*o> , 

\  xp+q+kQ  + 1 , 


(if  j  t  J0) 
(if  j  =  J0) 


Z 

q 


According  to  the  pivoting  process  of  the  dual-simplex  method,  we  have 


f  =  d^o)  +  —  d^ 


0,0 


o,  o 


(39) 


Because  of  the  dual  feasibility  of  the  system  (28)  and  (29),  d^®^  >  0  and  hence 

s.  <  d^?^  .  Therefore,  (39)  implies  that 
Jo“  °*Jo 


0,0 


d^o) 

o,  o 


+  s  =  h 


4-6 


LOCKHEED  MISSILES  ft  SPACE  COMPANY 


6-90-63-35 


On  the  other  hand,  since 


it  follows  that 


f  <  d*k)  < 

0,0=  O,  0  = 


e  <  h  , 
0=0 


(k  >  k  ) 
'  o' 


o,  o 


,(k) 

d  =  e 
o,o  c 


=  h 


(k>ko> 


Thus,  we  have  proved  that  the  limit  eQ  is  an  integer  and  that  there  exists  an  integer 

k  such  that 
o 


j(k)  = 
o,  o 


(k 


k  ) 
o' 


(k) 

Now,  let  us  consider  those  vectors  6q  with  k  >  kQ.  Since 


6<k»  <  (k*D  _  d^+D 

0=0  *  0,0  0,0 


for  every  k  >  kQ,  we  have 


d 


(k+  1) 
1,0 


(40) 


for  every  k  >  kQ.  In  other  words,  the  infinite  sequence 


d(ko+D 

1,0 


,  d 


(k0  +  2) 

1,0 


is  monotone  nondecreasing. 


(41) 


We  will  prove  that,  under  our  additional  assumption  made  at  the  beginning  of  this 
section,  the  sequence  (41)  is  bounded. 
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If  the  condition  (A)  is  satisfied,  then  the  continuous  function 


q 

xi  =  ai,0  +  £ 

J-l 

is  bounded  for  all  feasible  solutions  of  (2).  Since  ^ 
feasible  solution 


(42) 

is  the  value  of  (42)  for  the 


t.  =  x  .  =  d^| . 
j  P  +  j  P  +  J.o 

where  j  =  1,  2,...,  q,  the  sequence  (41)  is  bounded. 

On  the  other  hand,  if  the  condition  (B)  is  satisfied,  then  we  have 

ao,j  >  °»  (J  *  1»  2  , q) 

For  each  k  >  kQ,  we  have 


e 


o 


a 


0,0 


+ 


f  a  .d« 

o,j  p  +  j,o 

1  =  1 


This  Implies  that 


(k) 

+  1. 


o 


(e  -  a  )  A 
'  O  o,o'/ 


o,j 
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for  every  j  *=  1,  2,.,.,  q  and  therefore 


0  < 
S= 


q 


1.0 


*  i 

j=i 


i.j 


(e. 


>,o*/ao,j 


for  every  k  >  kQ.  Hence  the  sequence  (41)  is  bounded. 

Thus,  we  have  proved  that  the  sequence  (41)  is  bounded  when  at  least  one  of  the  two 
conditions  (A)  and  (B)  holds. 


As  a  nondecreasing  bounded  sequence,  (41)  converges  to  its  least  upper  bound  e^, 
in  symbols 


Lim  =  e.  (43) 

k— oo  1,w  1 


Let  h^  denote  the  smallest  integer  not  less  than  e^,  then  we  have 

e.  <  hf  ,  hf  -  et  <  1 
l=o  o  1 

By  (43),  there  exists  a  nonnegative  integer  kj  >  kQ  such  that 


s'  =  h'  -  df  *}  <  1 

o  o  1,0 

On  the  other  hand,  since  e^  is  the  least  upper  bound  of  the  sequence  (41),  we  have 


s'  =  h'  -  d^1*  >  0 
o  o  1,0  = 


If  Sj  =  0 ,  then  we  have 


(>9 

dl,0  =  el 


-  ho 
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Hence  e^  =  h^  is  an  integer  and 

di?0  =  el  =  ho’  <k>ki>  (44) 

Otherwise,  if  s’  >  0,  then 
o 


=  h’  -  s’ 
o  o 


is  not  an  integer.  Since 


d^i)  = 

0,0 


is  an  integer,  it  follows  from  the  rule  of  choosing  an  equation  in  the  iterative 
process  that  the  equation 


is  to  be  chosen  to  construct  the  new  equation 


p  +  q  +  k^  + 1 


-s;  + 


1 8i  w{ 

J  =  l 


(ki) 


(45) 


where 


sj  =  d£l>  -  hj  ,  (j  =  1,  2 . q) 

with  h.'  standing  for  the  largest  integer  not  greater  than  d?1 ^ 
J  **  J 
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Next  we  adjoin  the  equation  (45)  to  the  system  (28)  and  (29)  with  k  =  and  apply 

the  dual-simplex  method  to  the  system  (28),  (29),  and  (45).  By  assumption,  we  can 

obtain  an  optimal  solution  given  by  the  vector  6^1^  ^  .  Since  -s^  is  the  only 

negative  constant  term  in  the  system  (28),  (29),  and  (45),  the  first  pivoting  in  the 

dual -simplex  method  is  to  replace  one  of  the  nonbasic  variables  w^ ^  , . . .  , 

by  the  new  variable  xp  +  q  l  .  If,  according  to  the  rule  of  the  dual-simplex 

method,  the  variable  w.  is  selected  to  be  replaced  by  x  .  ,  ,  ,  then  the 

Jo  p  +  q  +  1 

equations  (28),  (29),  and  (45)  will  be  transformed  into  the  form  (37)  and  (38)  with 


i  =  1,  2 
given  by 


p  +  q+  k^  +  1,  where  the  new  nonbasic  variables  z^ 


z  are 

q 


Xp  +  q  +  kx+  1 , 


(if  j  *  JQ) 

df  j  -  j0> 


By  the  pivoting  process,  we  have 


f 

o, 


o 


j^i) 

o,  o 


+ 


o 

s ! 

J 


(46) 


On  the  other  hand,  we  have 


d(ki>  <  f  < 

0,0  =  0,0  =  0,0  0,0 


Since  s^  /  0 ,  (46)  and  (47)  imply 


=  0 


(47) 


(48) 
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Because  of  the  dual  feasibility,  (48)  implies 

d^V  >  0  (49) 

L,)o 

This  fact  (49)  implies 

8i0  S  dM0  <50> 

Then,  by  the  pivoting  process,  we  have 


because  of  (50).  On  the  other  hand,  since 

fi,o  =  di?o  =  ei=  ho*  ^  >  ki> 

it  follows  that 

fl  0  =  dfo  =  ei  ■  ho  .  (k  >  kx) 

Thus,  we  have  proved  that  the  limit  of  (43)  is  an  integer  and  that  there  exists  an 
integer  kj  >  kQ  such  that 

d^Q  =  ei*  (k  >  kj) 
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We  can  now  repeat  the  same  argument  given  above  for  i  =  2,  3 
apply  the  mathematical  induction.  Hence,  for  every  i  =  0,  1  , 
sequence 


converges  to  a  limit 


Lim  =  e 

i’0  1 


where  e^  is  an  integer;  furthermore,  there  exists  an  integer  k 


(k  >  k{) 


Finally,  let  k  be  a  finite  integer  such  that 

k  >  k.,  (i  =  0,  1,...,  p  +  q) 


Then  it  follows  that 


V  =  dM  =  e 
J  0,0  o 


xi =  dul> =  ei  ’  <* = 2 . 1 


is  an  integral  optimal  solution  and  the  process  terminates  after 
completes  the  finiteness  proof. 
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Section  5 

AN  ILLUSTRATIVE  EXAMPLE 

In  this  section,  we  shall  study  the  standard  integral  minimum  program  of  finding 
nonnegative  integers 


*1*  V  *3’  V  *5*  V  V  V  *9’  * 


10 


which  minimize  a  given  linear  function 


y  =  H  +  H  +  *3  +  U  +  *5  +  H  +  H  +  H  +  *9  +  t10 

subject  to  a  system  of  20  linear  inequalities: 


t 

t 


1 

1 


Ho  "  *3  "  H 
Ho  "  *5  ~  *8 

*10  '  H  "  H  "  *8 

Ho  ~  H  "  H  "  H 

Ho  “  H  “  H  "  *3  “  *5 
*4  +  *9  ‘  410  -  1 

*6 +  H  ‘  Ho  - 1 


H  +  H  +  *9  “  Ho  “ 1 
H  +  *4  +  *8  ■  Ho  "  1 
*3  +  H  +  *5  -  Ho  -  1 
+  t2  +  t8  +  te"Ho_1 
+  H  +  U  +  *5  "  Ho "  1 


>  0 
2  0 

>  0 
=a 

>  0 
£  0 
>  0 
>  0 
>  0 
>  0 
>  0 

>  0 

>  0 
3 
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»2  '  *1  ^  ° 

*3  '  *2  -  ° 

U  '  H  *  0 

H  -  H  *  0 

*6  '  *5  -  ° 

H  '  ‘6  *  ° 

*8  -  *7  *  0 

H  -  *8  -  ° 


Next,  we  introduce  slack  variables  x^,  (1  <  i  <  20) ,  for  the  left  members  of  these 
inequalities.  Thus,  the  given  problem  is  reduced  to  that  of  finding  nonnegative  integers 
y,  Xj,  and  t^,  which  minimize  y  subject  to  the  following  twenty-one  equations: 


y 

*1  +  H  +  *3  +  *4  + 

*5  + 

xi 

= 

*10  "  H  "  *9 

X2 

= 

*10  '  H  "  *8 

X3 

= 

Ho  ”  H  “  H  "  H 

X4 

= 

Ho  -  H  -  H  -  *B 

X5 

= 

Ho -  H  "  H  "  H 

‘  *5 

x6 

- 

H  +  H  '  Ho " 1 

*7 

= 

*6 +  H  -  Ho  - 1 

X8 

= 

H  +  H  +  H  _  Ho 

-  1 

*9 

= 

o 

1 

CD 

+ 

+ 

iH 

-  1 

X10 

= 

*3  +  H  +  *B  '  Ho 

-  1 

X11 

= 

H  +  t2  +  t3  +  t6- 

Ho 

X12 

= 

H  +  t2  +  t4  +  l8‘ 

Ho 

+  *8  +  *9  +  *10 
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13 


'14 


15 

x,  „ 

lo 


'17 


=  42  -  *1 

"  *8  -  *2 

“  44  "  *3 
t_  -  t . 


t„  -  t„ 


18 


19 


20 


=  t„ 


=  t„ 


l9  "  *8 


Since  all  coefficients  of  the  linear  function  y  are  positive,  the  problem  is  dually 
feasible;  hence,  we  can  apply  the  dual-simplex  method  and  write 

X20  +  j  =  V  (1  ^  J  ^  10) 

Then  we  can  write  the  initial  tableau  T  . 


For  definiteness,  we  choose  the  first  variable  with  a  negative  constant  term  as  the 
new  nonbasic  variable  in  each  pivoting  operation. 


After  twelve  pivoting  operations,  we  obtain  a  nonintegral  optimal  solution. 

The  thirteen  tableaux  of  these  operations  are  given  as  follows.  The  pivot  element 
in  each  tableau  is  circled. 
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Tableau 
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Since  the  constant  column  in  T^2  is  nonnegative,  we  obtain  an  optimal  solution 


4 

- 

X21 

- 

2 

4 

- 

X22 

= 

2 

l3 

= 

X23 

3 

4 

= 

X24 

= 

5 

4 

= 

X25 

- 

5 

4 

s= 

X26 

= 

6.5 

4 

= 

X27 

= 

6.5 

4 

s= 

00 

OJ 

X 

= 

6.5 

4 

X29 

= 

9 

4o 

= 

X30 

= 

12 

The  minimum  of  the  linear  function 


10 

is 

J  =  1 


for  all  feasible  solutions  is  57.  5.  This  optimal  solution  is  not  integral;  in  fact,  it  is 
obvious  that  no  integral  feasible  solution  can  give  y  the  nonintegral  value  57.  5. 

To  find  an  integral  optimal  solution  for  our  problem,  let  us  apply  the  process 
described  in  section  3. 
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Since  the  leading  element  57. 5  in  the  constant  column  is  nonintegral,  we  choose  the 
equation 


y  =  57.  5  +  23.  5  xg  +  13.  5  x^3  +  32.  5  +  22.  5  x^ 

+  d-5x16  '  x19  !  15  X7  ‘  -5x18  +  9xS  t  27  x4 
in  the  construction  of  the  new  equation.  Thus,  we  obtain  the  new  equation 

X31  =  -  .5  +  .5  xg  +  .5  x13  +  .5  x10 

+  *6xl  +  ’ 5  x16  +  -5x7  +  ‘5x18 

Adjoin  a  new  row  corresponding  to  this  additional  constraint  to  the  last  tableau  T^2. 
Hence  we  obtain  the  following  expanded  tableau  T^3  . 

In  T^3  ,  since  -.5  is  the  only  negative  entry  in  the  constant  column,  we  have  to  use 
x3j  as  the  new  nonbasic  variable.  The  pivot  element  is  marked  by  a  circle.  After 
the  pivoting  operation,  we  obtain  the  tableau  T^. 


5-18 


LOCKHEED  MISSILES  &  SPACE  COMPANY 


I 

I 


Tableau  T 


6-90-63-35 


13 


5-19 


LOCKHEED  MISSILES  ft  SPACE  COMPANY 


6-90-63-35 


5-20 


LOCKHEED  MISSILES  &  SPACE  COMPANY 


6-90-63-35 


Now,  in  the  tableau  T^,  all  entries  are  nonnegative  integers.  Hence,  we  obtain  an 
optimal  integral  solution 


t„  =  x0 


trt  =  x, 


22 


trt  =  x 


23 


t,  =  x 


24 


t„  =  x 


25 


=  x, 


26 


=  x, 


27 


=  x, 


28 


U  =  x 


29 


10 


=  x, 


30 


2 

2 

3 

5 

5 

6 
7 
7 
9 
12 


The  minimum  of  the  linear  function 


10 


y =  2  h 

j=i 


for  all  integral  feasible  solutions  is  58. 
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Section  6 

SWITCHING  FUNCTIONS 


Let  Q  denote  the  set  that  consists  of  the  two  integers  0  and  1.  For  any  given 
integer  n  >  1,  consider  the  Cartesian  power 

Qn  -  Q  x. . .  x  Q 

which  is  the  Cartesian  product  of  n  copies  of  Q.  Thus,  the  elements  of  Qn  are  the 
2n  ordered  n -tuples 


<xr  x2 . V 

where  the  coordinate  x^  is  in  Q  for  every  k  =  1,  2  , . . . ,  n.  Hereafter,  Qn 
will  be  called  the  n-cube  and  its  2n  elements  will  be  called  its  points. 

By  a  switching  function  of  n  variables,  we  mean  any  subset  F  of  the  n-cube  Qn. 

Since  Qn  has  2n  points,  there  are  22n  different  switching  functions  of  n  variables. 

A  switching  function  F  of  n  variables  is  said  to  be  linearly  separable  provided  that 
there  exist  n  +  1  real  numbers  w^#  w2  , . . .  ,  wfl>  wr+  1  such  that,  for  every  point 

x  =  (Xj,...,  xn)f  Qn 


we  have  xfF  if  and  only  if 


wlxl  + 


+  w  X  <  w  ,  - 
n  n  =  n+  1 


The  set  W  =  (w1  , . . . ,  wr,  wn+  j)  is  called  a  separating  system  of  F  ;  the  real 
numbers  w^  , . .  • ,  wfl  are  called  the  weights,  and  the  real  number  wr+  1  is  called 
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the  threshold.  By  taking  the  threshold  wr+1  as  small  as  possible  while  the  weights 

w„ , . . . ,  w  are  held  fixed,  we  may  assume  that,  In  case  F  is  not  empty,  there 
1  n 

exists  a  point  x  =  x^)  in  F  such  that 


W1  X1  + 


+  W  X  =  W  - 

n  n  n+  1 


Consider  the  complement 


F'  =  Qn  -  F 


of  F.  For  every  point  y  *  (y^ . yn)  in  F\  we  have 

W1  ^1  +  •  *  •  +  wn  yn  >  wn+  1 
Let  M  denote  the  minimal  value  of 


for  all  points  y  =  (y^ . yn)  in  F*  in  case  Ff  is  not  empty.  This  positive  real 

number  M  is  called  the  margin  of  the  separating  system  W  (Ref.  15,  p.  6).  A 
separating  system  W  =  (w1  , . . . ,  w^,  wn+  1)  of  F  is  said  to  be  normal  provided 
that  M  =  1.  Every  separating  system 


W  -  (w. 


w 


w 


of  F  can  be  normalized  by  dividing  each  (i  =  1  n  +  1),  by  the  margin 

M  of  W.  Precisely,  the  set 


W'  =  (wi 


w 


with  w*  =  Wj  /M  for  each  i  =  l,...,n  +  l  is  a  normal  separating  system  of  F. 
Hence,  every  linearly  separable  switching  function  F  has  a  normal  separating 
system. 
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Let  W  -  (Wj  , . . . ,  wn>  wr+  j)  be  any  normal  separating  system  of  a  given  linearly 
separable  switching  function  F  of  n  variables.  Then,  for  every  point 


x  =  (xx . Xfl)  f  Qn 


we  have 


w,  x-  +  •  •  •  +  w  x  <  w  . ,  (if  x  f  F) 

11  n  n  =  n+1  '  ' 

w-  x-  +  —  +  w  x  >  w  .  +  1,  (if  x  €  Ff) 

11  nn=n+l  '  ' 

By  a  canonical  switching  function  of  n  variable,  we  mean  a  linearly  separable 

switching  function  F  of  n  variables  which  admits  a  separating  system 

W  =  (w-  w  ,  w  -)  satisfying 

i  n  n+ 1 

0  1  wl^  w2=  •  =Wi=  wi+l=-"  =  wn 

in  words,  the  weights  wi  > • • • »  wn  in  W  are  nonnegative  and  nondecreasing. 

It  is  well  known  (Refs.  16  and  17)  that  every  linearly  separable  switching  function  F 
of  n  variables  can  be  reduced  to  a  unique  canonical  switching  function  by  permuting 
and  complementing  a  number  of  the  variables. 
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Section  7 

REGULAR  SWITCHING  FUNCTIONS 


By  a  weight  function  of  n  variables,  we  mean  a  homogeneous  linear  function 

w  :  Rn — — R 

on  the  n-dimensional  Euclidean  space  Rn  with  real  values.  Precisely,  there  are 

n  real  numbers  w^^  , . . .  ,  wfl  such  that,  for  an  arbitrary  point  x  =  (x^ . xr) 

of  Rn  ,  we  have 


w(x)  =  w^  x^  +  . . .  +  wn  xn 

The  real  numbers  _ _ _  are  called  the  coefficients  of  the  weight  function  w. 

A  weight  function  w  :  Rn — —  R  with  coefficients  w^,,,,,  w  is  said  to  be 
canonical  provided 


0  <  w„  <  wn  <  . . .  <  w.  <  w.  .  <  . . .  <  w 
=  1-  2  =  =  i=  1+1=  =  n 

By  means  of  the  canonical  weight  functions  of  n  variables,  we  can  define  a  partial 
order  in  the  n-cube  Qn  as  follows:  Let  x  =  (x^  , . . . ,  xn)  and  y  =  (y^  , . . . ,  y^) 
be  any  two  points  of  Qn  ;  then  we  define 

x  <  y 


if  and  only  if 


w(x)  <  w(y) 
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for  every  canonical  weight  function  w  of  n  variables.  This  partial  order  in  Qn 
is  called  the  canonical  partial  order  (Ref.  17). 

The  following  criterion  for  <  was  established  in  Ref.  17.  For  arbitrary  points 
x  =  (Xjm.mXJ  and  y  =  (yj,...,  y  )  of  Qn  ,  we  have  x  <  y  if  and  only  if 

n  n 

Xv-2», 

j=i  j=i 

for  every  i  =  1,  2 .  n  , 

With  respect  to  the  canonical  partial  order  in  the  n-cube  Qn  ,  we  define  the  maximal 
points  and  the  minimal  points  of  an  arbitrarily  given  switching  function  F  of  n 
variables  as  follows.  A  point  x  of  F  is  said  to  be  maximal  provided  that,  for  an 
arbitrary  point  y  of  F,  x  <  y  implies  x  =  y.  Similarly,  a  point  x  of  F  is 
said  to  be  minimal  provided  that,  for  an  arbitrary  point  y  of  F,  y  <  x  implies 
y  =  x. 

Using  the  canonical  partial  order  <  in  the  n-cube  Qn  ,  we  can  define  the  regular 
switching  functions.  A  switching  function  F  of  n  variables  is  said  to  be  regular  if 
and  only  if  it  satisfies  the  following  regularity  condition: 

If  xrF  and  y  <  x,  then  y  f  F. 

Obviously,  every  canonical  switching  of  n  variables  is  regular.  In  Ref.  18,  it  was 
proved  that  every  regular  switching  function  of  n  <  5  variables  is  canonical;  in 
Ref.  6,  an  example  is  given  which  shows  that  not  every  regular  switching  function  of 
6  variables  is  canonical. 
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Section  8 

SYNTHESIS  AND  MINIMIZATION 


Let  F  be  an  arbitrary  switching  function  of  n  variables.  The  synthesis  problem 
for  the  linear  separability  of  F  is  to  determine  whether  or  not  F  is  linearly 
separable  and  to  find  a  separating  system  (w.^  , . . . ,  wr,  wr+  for  F  in  case  F  is 
linearly  separable. 

Among  various  synthesis  methods  for  linear  separability  introduced  in  the  literature, 
the  one  given  by  D.  G.  Willis  (Ref.  1)  turns  out  to  be  the  most  convenient  because  it 
involves  as  few  linear  inequalities  as  possible.  In  Ref.  1,  the  synthesis  problem  for 
the  linear  separability  of  arbitrary  switching  functions  of  n  variables  was  reduced 
to  that  of  the  regular  switching  functions  of  n  variables.  Thus,  it  remains  to 
determine  whether  or  not  a  given  regular  switching  function  F  is  linearly  separable 
and  to  find  a  normal  canonical  separating  system  (w^  , . . . ,  wn,  wr  +  for  F  in 
case  F  is  linearly  separable  and  hence  canonical. 

For  the  convenience  of  the  reader,  we  shall  briefly  describe  the  Willis  synthesis 
method. 

Let  F  be  an  arbitrary  regular  switching  function  of  n  variables.  We  assume  that 
F  is  nontrivial,  i.e.  , 


F  t  □,  F  ^  Qn 

where  □  denotes  the  empty  set.  Let  L  denote  the  set  of  all  maximal  points  of  F; 
and  let  M  denote  the  set  of  all  minimal  points  of  the  complement  Ff  =  Qn  -  F. 
Let 


a.  =  (a.1  ajn),  (i  =  1  ,  2  , . . . ,  p) 
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be  the  points  of  L  and 


hj  -  (bj^  * ...  i  bj^),  (1  ~  1 1  2  , , . . ,  q) 

be  the  points  of  M.  Consider  the  following  system  of  p  +  q  +  n  linear  inequalities: 

n 

£aikWk  <  wn+i-  (i  =  2 . p) 

k  =  1 

(51) 

n 

S  bjk  wk  =  wn+l  +  1>  ®  =  lf  2 . 

k  =  l  J 

0  <  w,  <  wn  <  . . .  <  w 
=1=2=  =  n 

Then,  the  Willis  synthesis  theorem  states  that  the  given  regular  switching  function  F 
is  linearly  separable  if  and  only  if  the  system  (51)  of  linear  inequalities  has  a  solution 
(and  hence  an  integral  solution). 

In  our  previous  reports  (Refs.  2-5),  various  methods  were  applied  to  solve  the 
system  (51). 

The  next  problem  is  naturally  the  minimization  problem,  which  is  to  find  the  most 
economical  solution  of  the  system  (51)  in  case  the  given  regular  switching  function  F 
is  linearly  separable.  In  other  words,  the  minimization  problem  is  to  find  a  solution 

<W1 . V  w 

of  the  system  (51)  which  makes  some  cost  function  0  (w^  , . . . ,  wn>  wn  +  ^)  minimal. 
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For  the  minimization  problem,  let  us  first  pick  up  the  cost  function  0  .  Assume  that 
the  cost  of  realizing  the  w.  is  proportional  to  the  magnitude  of  for  each 
i  =  1,  2  , . . . ,  n+ 1  .  Under  this  assumption,  the  cost  function  0  will  be  a  homo¬ 
geneous  linear  function. 


n+1 


0  (w1 


w 


w 


Yiwi 


(52) 


where  the  coefficients  y^  , . . . ,  Tn  +  are  nonnegative  real  numbers.  In  the 

literature  (see  Ref.  8),  two  different  cost  functions  have  been  studied;  one  of  these 

is  defined  by  y.  =  1  for  all  i  =  1,  2  , . . . ,  n,  n  +  1  and  the  other  is  given  by  y  ^  =  1 

for  i  =  1,  2  , . . . ,  n  and  y  ,  .  =  0. 

n+1 

Having  fixed  the  cost  function  0  by  (52),  the  minimization  problem  for  a  given 
regular  switching  function  F  is  that  of  finding  a  normal  canonical  separating  system 
that  minimizes  0  ;  in  other  words,  the  minimization  problem  is  the  standard  linear 
program  of  finding  nonnegative  real  numbers. 


w- ,  w„  , . . . ,  w  ,  w  ,  - 
V  2’  9  n  n+1 

which  minimizes  the  cost  function  (52)  and  satisfy  the  system  (51),  or  equivalently  the 
following  system  of  m  =  p  +  q  +  n-1  linear  inequalities: 


'  £  aik  wk  +  Wn+1  ^  °’  (i=1’  2 . p) 


k  =  1 


"  1  +  2  bjkWk  '  %+!  =  °*  (j  =  1,  2 . q) 


k  =  1 


wk+l  -wk=>0' 


(k  -  1,  2  , , . . ,  n  +  1) 


(53) 
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In  an  earlier  report  (Ref,  19),  it  was  proved  under  the  assumption 

y  >  0 

n 

that  this  minimization  problem  for  F  has  optimal  solutions  in  case  it  is  feasible. 

In  other  words,  if  Yn  >  0,  then  every  linearly  separable  regular  switching  function 
F  of  n  variables  has  a  minimal  normal  canonical  separating  system. 

Various  algorithms  for  computing  these  minimal  normal  canonical  separating  systems 
were  proposed  in  our  recent  reports  (Refs.  6  and  7).  In  particular,  if 

>  0  ,  (i  =  1,  2 . n)  (54) 

the  minimization  problem  is  dually  feasible  for  every  nonempty  regular  switching 
function  F  and  hence  the  dual-simplex  method  can  be  very  efficiently  applied  without 
the  work  of  finding  a  feasible  solution  first  (see  Ref.  7). 
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Section  9 

INTEGRAL  MINIMIZATION  PROBLEM 


Throughout  the  present  section,  let  us  assume  that  the  cost  function  (52)  satisfies  the 
condition  (54)  and  that  the  given  regular  switching  function  F  of  n  variables  is 
nontrivial,  i.  e.  , 


F  +  □  ,  F  +  Qn 

For  most  of  the  threshold  devices  realizing  linearly  separable  switching  functions,  the 
numbers 


w 


1* 


w  r 


w 


w 


n  + 


1 


are  required  to  be  integers.  Hence,  we  want  to  find  nonnegative  integers  w^, 

(i  =  1,  2  , . . . ,  n  +  1),  which  minimize  the  cost  function  (52)  and  satisfy  the  system 

(53)  of  linear  inequalities.  In  this  integral  minimization  problem,  the  coefficients 

y,  , . . . ,  y  ,  are  assumed  to  be  nonnegative  integers.  Hence,  the  value  of  the  cost 
1  n  + 1 

function  (52)  for  any  integral  feasible  solution  of  the  problem  is  also  a  nonnegative 
integer. 

The  optimal  solutions  of  the  minimization  problem  in  the  preceding  section  may  be 
not  integral.  For  example,  let  us  consider  the  regular  switching  function 

F  =  987643^51^1/2 

of  nine  variables  in  the  notation  introduced  in  our  earlier  report  (Ref.  20).  This 

9 

regular  switching  function  F  consists  of  58  points  of  the  9 -cube  Q  ,  and  its 

9  9 

complement  F1  consists  of  2  -  58  =  454  points  of  Q  . 
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By  the  methods  developed  In  Refs.  20  and  21,  one  can  find  the  set  L  of  all  maximal 

points  of  F  and  the  set  M  of  all  minimal  points  of  its  complement  F' .  Indeed, 

g 

L  consists  of  the  following  five  points  of  Q 

(0,  0,  1,  0,  0,  0,  0,  0,  1) 

(0,  0,  0,  0,  1,  0,  0,  1,  0) 

(0,  1,  1,  0,  0,  0,  0,  1,  .0) 

(0,  1,  0,  1,  1,  0,  0,  0,  0) 

(1,  1,  1,  0,  1,  0,  0,  0,  0) 

0 

and  M  consists  of  the  following  seven  points  of  Q 

(0,  0,  0,  1,  0,  0,  0,  0,  1) 

(0,  0,  0,  0,  0,  1,  1,  0,  0) 

(1,  1,  0,  0,  0,  0,  0,  0,  1) 

(1,  0,  0,  1,  0,  1,  0,  0,  0) 

(0,  0,  1,  1,  1,  0,  0,  0,  0) 

(1,  1,  1,  0,  0,  1,  0,  0,  0) 

(1,  1,  0,  1,  1,  0,  0,  0,  0) 

Assume  the  cost  function  to  be  the  following  linear  function 

y  =  Wj  +  w2  +  w3  +  w4  +  w5  +  w6  +  w7  +  wg  +  w9  +  w1Q 

Then,  one  can  easily  see  that  our  minimization  problem  reduces  to  the  illustrative 
example  in  section  5  with  t^  =  for  each  j  =  1,  2  , . . . ,  10.  Hence,  after 
twelve  pivoting  operations,  the  dual -simplex  method  gives  an  optimal  solution 
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with  the  minimal  total  cost 

y  -  57.5 

Hence,  this  regular  switching  function  F  is  the  one  studied  by  D.  G.  Willis 
(Ref.  8). 

Since  the  minimal  total  cost  is  57.  5  ,  no  integral  feasible  solution  can  be  an  optimal 
solution.  In  fact,  D.  G.  Willis  proved  that 

(2,  2,  3,  5,  5,  6.5,  6.5,  6.5,  9,  12) 

is  the  only  minimal  normal  separating  system  for  F. 


Now,  let  us  return  to  the  general  case  described  at  the  beginning  of  this  section. 
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Apply  the  dual-simplex  method  to  our  minimization  problem.  The  result  will  be  that 
either  F  is  not  linearly  separable  or  an  optimal  solution  can  be  obtained  from  the 
final  simplex  tableau. 

If  the  optimal  solution  obtained  by  the  dual-simplex  method  consists  of  integers  only, 
then  we  have  obtained  an  integral  normal  canonical  separating  system  which  is 
minimal  for  all  normal  canonical  separating  systems  of  F.  Thus,  the  problem  of 
finding  minimal  integral  weights  and  threshold  is  solved  in  this  case. 

Otherwise,  if  the  optimal  solution  is  not  integral,  then  we  can  apply  Gomery's  method 
as  described  in  section  3.  It  remains  for  us  to  verify  that  the  finiteness  proof  in 
section  4  holds  for  this  special  case. 

In  case  y^  +  ^  >  0,  the  condition  (B)  at  the  beginning  of  section  4  is  satisfied  since 
F  is  linearly  separable  and 


yi  ^  0,  (i  1*  2  , . . . ,  n  +  1). 

Hence,  the  finiteness  proof  holds  for  this  case. 

On  the  other  hand,  let  y  -  =  0.  Since  F  ^  Qn  ,  it  follows  that  the  unit  point 

n  +  1 

(1,  1  , . . . ,  1)  of  Q  is  in  the  complement  Ff  and  hence 

n 

w  it  <  )  w.  -  1 
n+1  «  Z*  i 

i=  1 

for  every  feasible  solution  (w^  f . . .  f  w  j)  °f  (53).  Hence,  in  the  finiteness  proof, 
we  can  also  prove  that  the  sequence  (41)  is  bounded.  Therefore,  the  finiteness  proof 
holds  also  for  this  case. 
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Thus,  after  a  finite  number  of  iterations  of  the  process  described  in  section  3,  we 
will  get  a  minimal  integral  solution  of  our  minimization  problem. 

Let  us  consider  the  regular  switching  function 

F  =  98764^65^53/2 

of  nine  variables  again.  We  have  observed  that  the  dual-simplex  method  gives  us  the 
optimal  solution  (55)  with  cost  y  =  57.5  .  Since  this  solution  is  not  integral,  we 
apply  Gomery’s  process  to  the  resulting  system.  As  shown  in  section  5,  we  obtain 
finally  an  optimal  integral  solution 


with  total  cost 


Wn 


W4  = 


= 


W„  = 


W0  = 


= 


w 


10 


2 

2 

3 

5 

5 

6 
7 
7 
9 

12 


y  =  58 


Thus  we  have  obtained  a  minimal  integral  normal  canonical  separating  system 


(2,  2,  3,  5,  5,  6,  7,  7,  9,  12) 
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of  the  given  regular  switching  function  F  of  nine  variables;  where 


(2,  2,  3,  5,  5,  6,  7,  7,  9) 


are  the  weights  and  12  is  the  threshold. 
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